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INTRODUCTION 

Measuring variation in implementation of public 
health interventions and levels of population expos- 
ure is an important part of evaluation. 1-4 In the 
context of effectiveness trials, exposure data can be 
used to interpret the impact of the intervention on 
the study outcomes. 4 In interventions where par- 
ticipation is voluntary or self-selected, measures of 
exposure can highlight inequity of access to the 
intervention among population subgroups of inter- 
est in public health. 5 

A substantial body of work exists on measuring 
exposure to media and other blanket health promo- 
tion campaigns. 4 Less attention has been paid to 
measuring 'exposure to', or perhaps more appropri- 
ately 'participation in', complex public health inter- 
ventions delivered through community engagement 
approaches. During the 1980s and 1990s, a handful 
of large-scale, multicomponent, community- 
delivered public health interventions were conducted 
in the USA, and evaluations of these programmes 
included extensive process measures to estimate the 
levels of exposure to and/or participation in different 
components of the intervention, ranging from mass 
media to small-group health education classes. 6-8 
These studies used the amount of potential exposure 
events or participation time offered and the actual 
number of exposure events or duration of participa- 
tion as measures of implementation. They also 
attempted to weigh exposure to different interven- 
tion elements according to theoretically derived esti- 
mates of their relative effectiveness. More recently, 
Oakley and colleagues 9 have suggested that quantita- 
tive and qualitative process evaluation of exposure to 
interventions should be considered an essential com- 
ponent of randomised controlled trials of complex 
public health interventions. This is because they can 
help, inter alia, to monitor the dose and reach of the 
intervention, to investigate contextual factors that 
influence effect, to explore the relationship between 
trial outcomes and variation in the extent and quality 
of implementation and to identify processes that 
might mediate the relationship between intervention 
and outcomes. However, high-quality process evalu- 
ation and measurement of exposure to intervention 
in complex public health interventions that use com- 
munity engagement approaches is often difficult to 
achieve and difficult to resource. 

In this paper, we describe the measures of inter- 
vention exposure used in the cluster randomised 
trial of the Well London programme, a public 



health intervention using community engagement 
and community-based projects to increase physical 
activity, healthy eating and mental health and well- 
being in 20 of the most deprived neighbourhoods 
in London. 10 No earmarked resources to support 
the development of these measures and associated 
data collection were provided to either the research 
team or to those delivering the interventions on the 
ground. Instead, these were derived from contractu- 
ally specified performance management informa- 
tion reported quarterly by partners and by 
inclusion of questions seeking information about 
participation in the follow-up questionnaires used 
to measure the main trial outcomes. The exposure 
measures are consequently considerably less sophis- 
ticated than those used in the US studies, where 
earmarked funding was available. 

The main trial analysis did not provide evidence 
of neighbourhood-level effects on primary out- 
comes arising from delivery of the Well London 
programme, 11 while the nested qualitative study 
indicated that active participation in the pro- 
gramme was key to improvements in subjective 
well-being. 12 

This paper aims (a) to describe the measures of 
exposure to Well London available for the trial ana- 
lysis, (b) report the levels (and where possible 
sociodemographic correlates of) exposure and (c) 
examine the relationship between the trial out- 
comes and exposure measures. These analyses were 
prespecified in our trial analysis plan. In addition, 
we consider the limitations of our exposure mea- 
sures and the importance and methodological chal- 
lenges of measuring exposure in the evaluation of a 
community-level intervention. 

METHODS 

Well London cluster randomised trial 

Methods for the CRT design and analysis are 
described in detail elsewhere, 10 11 but information 
relevant to this paper is summarised here. Twenty 
matched pairs of deprived neighbourhoods in 
London were randomised to receive the Well 
London programme or be a control area. Trial out- 
comes were measured before (baseline) and after 
(follow-up) intervention delivery by an adult 
household survey and a school-based adolescent 
survey in intervention and control neighbourhoods. 
In these analyses, we used data from the adult 
household survey and programme monitoring 
activities. 
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The intervention 

Well London Phase- 1 was supported by the Big Lottery 
Well-being Fund and delivered between October 2007 and 
March 2011. The aim of the Well London programme is to 
support the development of social networks and resilience in 
communities, with additional changes to the food supply and 
the neighbourhood environment, to address the local structural 
and social determinants of health 13 14 and facilitate individual 
health behaviour change (nutrition and physical activity) and 
improve mental well-being. Delivery of the Well London pro- 
gramme was coordinated by the London Health Commission (at 
the Greater London Authority) and conducted in partnership by 
London Sustainability Exchange (LSx), Groundwork London, 
Central YMCA, Arts Council England, South London and 
Maudsley NHS Mental Health Trust (SLaM) and the University 
of East London. 

Each of these partners led a key theme of the programme, 
delivering their specific projects in all of the 20 intervention 
neighbourhoods. Each organisation also took an oversight role 
in three to four neighbourhoods, coordinating delivery of pro- 
jects by the other partners. This local delivery was organised in 
collaboration with a local cohosting statutory or voluntary 
sector organisation with knowledge about, and experience of 
working with, the community in that specific neighbourhood. 

Well London comprised 14 interlinked projects (detailed in 
table 1), some of which specifically focused on the main health 
outcomes (physical activity, healthy eating, mental health and 
well-being), while others sought to improve the local environ- 
ment (eg, green spaces), provide arts and cultural activities, or 
employment and training opportunities to residents. At the 
beginning of the programme, there was an extensive community 
consultation and engagement process in each neighbourhood 
(using World Cafe Appreciative Inquiry methodologies 15 16 ) to 
identify community needs and tailor the suite of projects. The 
funding conditions of Well London required that specified pro- 
jects be delivered in every neighbourhood addressing the health 
and well-being goals of the Big Lottery Well-being Fund (pro- 
jects involving healthy eating/cooking, arts and culture, physical 
activity, healthy spaces, positive mental well-being), although the 
number and content of sessions of the individual projects deliv- 
ered was tailored to local population needs and preferences, par- 
ticularly the arts and culture, physical activity and healthy 
spaces projects. A central part of the intervention was the 
recruitment of a core group of volunteers in each neighbour- 
hood who were trained to support other residents to participate 
in the Well London projects and to access health and social ser- 
vices and to improve health behaviours. 

The number of sessions and spaces available varied depending 
on the format of the activities. Table 1 provides an indication of 
the volume of participation opportunities in each project, 
although each was locally tailored. Data on sessions and spaces 
were not reliably provided by all delivery organisations, and 
hence were not considered in the analyses presented here. The 
timing and frequency of activity on each project theme in each 
neighbourhood is shown in the online supplementary file 1. 

Programme monitoring data 

During intervention delivery, monitoring data were collected 
from participants in project activities and from the delivery 
organisations. Three types of data were collected: (a) what was 
delivered — delivery organisations provided summaries of the 
activities they had delivered; (b) how many people participated 
— delivery organisations counted and reported the total number 



of participants for each project activity or session; and (c) who 
participated — at the end of each project session, participants 
were invited to complete a brief evaluation form requesting age, 
postcode, gender, number of activity sessions attended within 
the project and the number of other Well London projects in 
which they had participated. These data were collated for each 
3 -month period of programme delivery. 

Adult household survey data 

Two separate cross-sectional surveys were conducted with no 
follow-up of individuals between baseline and the end of the 
intervention. Households were selected at random from the Post 
Office Address File for each neighbourhood 11 and interviews 
requested from all adults (> 16 years) during fieldwork visits. 
Written informed consent was obtained from all participants. 
The domains covered in the questionnaire are presented in the 
online supplementary file 2, and the questions used to capture 
participation in Well London in the intervention and control 
neighbourhoods are shown in the online supplementary file 
3. A copy of the questionnaire is available from the authors 
upon request. 

Trial outcomes 

The primary outcomes were eating at least five portions of fruit/ 
vegetables per day, doing at least five sessions of 30 min of mod- 
erate intensity physical activity per week (or equivalent), a 
normal score on the GHQ-12 and the Warwick Edinburgh 
Mental Well-being Scale score. A range of secondary health and 
social outcomes were also examined (see online supplementary 
files 4 and 5). 

Measures of exposure to Well London 

Personal recall of participation 

Individual-level participation of respondents in the household 
adult survey was represented as a binary indicator (0=no par- 
ticipation at any time during the 3.5-year programme; ^indi- 
vidual had reported participating in any activities.) This was 
used in the individual-level regression analyses examining the 
association between self-reported participation and the trial 
outcomes. 

The prevalence of self-reporting any participation in Well 
London in the household adult survey was used as a 
neighbourhood-level measure of participation. 

Intensity of intervention delivery 

Two measures of intervention delivery intensity were created: 
Project contacts: The number of project contacts per 1000 
neighbourhood residents, estimated from the monitoring data 
as described in the online supplementary file 6. The measure 
constructed from the monitoring data is not a population rate 
of participation because residents could take part in more 
than one project during a reporting period and across the life- 
time of the programme and no unique identifiers were avail- 
able for de-duplication. These estimates were also not 
adjusted for the length and capacity of specific projects 
because these data were not reliably reported by delivery 
organisations. 

Project quarters: The number of calendar quarters (3 -month 
periods) that projects were offered (from the programme 
monitoring data). The Well London programme comprised 13 
separate projects and delivered over a 42-month period (14 
quarters), so the total possible number of project quarters 
delivered was 182, although each project was not delivered in 
every month of the programme. The delivery of each project 
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Table 1 Summary of project content and delivery 



Project title 



Project description 



Delivery lead 



Example capacity/duration 



Heart of the community projects 



CAD BE 



Training 
Communities 

Well London 
Delivery Teams 



Youth.com Unity 



Wellnet 



Active Living Maps 



Themed projects 
Eatwell 



Buywell 



Activate London 



Be Creative, Be Well 

Changing Minds 
DIY Happiness 
Healthy Spaces 



Mental Well-being 
Impact Assessment 



Consultation, assessment, design, brokerage, enterprise — 
includes community cafe needs assessments and appreciative 
inquiry workshops for design of suite of intervention projects 
that comprised the initial community engagement activities 
Training on a variety of topics to support delivery of the other 
Well London projects by residents in the LSOAs, for example, 
facilitation, community engagement 
Training for local volunteers in each LSOA to act in a similar 
role to NHS Health 

Trainers — to support people to develop healthier lifestyles 
through signposting to increase uptake of local services and 
peer support; the delivery team also act as advocates in 
interactions with local service providers 
Engaging young people to be actively involved in decision 
making in their local community and in transforming the 
community to improve health and well-being — youth 
ambassadors were recruited and trained in each LSOA 
Well London learning network for communities and 
professionals in London to share practice ideas and experience 
of delivering community-led interventions for improving health 
and well-being — it is not limited to delivery partners or areas 
involved in Well London 

Maps of facilities and opportunities for healthy activities/ 
lifestyle, for example, maps show sports facilities, parks, 
allotments — made for each LSOA and delivered in paper 
format to all residents 



Healthy cooking classes (cook and eat) and community feasts 
to provide engaging education about healthy eating and good 
nutrition 

Working with local retail outlets and with local community 
members to improve access to affordable healthy food that is 
sustainably produced 

Range of activities for both young people and adults to engage 
in physical activity; this involves one or more of signposting to 
existing local facilities and activities, capacity building by 
providing training to residents to run physical activity sessions 
in the LSOA, or direct delivery of, for example, taster sessions 
and courses and joint initiatives with residents and other 
providers 

Arts activities are used to engage residents in the LSOAs in a 
process of change to improve, health, well-being, community 
cohesion and the environment; uses intercultural and 
intergenerational approaches 

Recruits and trains local residents who have direct experience 

of mental ill health to deliver awareness training in the LSOAs 

to reduce stigma and discrimination 

Uses humour, creativity and positive psychology approaches to 

increase psychological resilience; workshops of eight 

participants, targeted at women 

Improve physical environments through development of 

community gardens and allotments and redevelopment of 

greenspaces and greenery 

Local residents are trained to understand, assess and 
demonstrate the impact of projects, activities and organisations 
in the LSOA on mental well-being 



University of East London Open to whole community. Ongoing from the 
project initiation. 

Community cafes (start of year 1 and year 2) 



South London and 
Maudsley NHS Mental 
Health Trust 
London Sustainability 
Exchange & Central 
YMCA 



Central YMCA 



London Sustainability 
Exchange 



London Sustainability 
Exchange 

London Sustainability 
Exchange 

Central YMCA 



Arts Council England 



South London and 
Maudsley NHS 
Mental Health Trust 
South London and 
Maudsley NHS Mental 
Health Trust 
Groundwork London 



South London and 
Maudsley NHS 
Mental Health Trust 



Ongoing, individual opportunities on application 
Ongoing, individual opportunities on application 



Ongoing from project initiation, a few individuals in 
each neighbourhood selected 



Ongoing from project initiation 



Groundwork London Delivered to all homes 



Small groups (~10 people), repeated delivery in 
each 3-month period 

Ongoing from project initiation 



Variable format (small group exercises, football 
tournaments, existing provision) and according to 
need. Some provision in every 3-month period 



Variable format (community sculptures, parades, 
small group activities). Activity throughout the 
programme 

Small group, high-intensity training (~5 people per 
area), delivered once 

Small groups (~10 people) 



Projects in all areas, variable format (community 
allotments, new gardens and changes to urban 
space) 

Small groups (~10 people) trained and undertook 
assessment, two per neighbourhood 



CADBE, Community Engagement, Assessment, Design, Brokerage, Enterprise; LSOA, Lower super output area. 



across the intervention neighbourhoods is summarised in the 
online supplementary file 1. 

The majority of projects required active, identifiable involve- 
ment from participants, for example, exercise or cooking 
classes. Residents were passively exposed to a few intervention 
components, such as changes to the green space and local envir- 
onment, or changes to the commercial provision of fruit and 
vegetables or other aspects of the local food environment. 



These environmental aspects of the intervention programme, 
and the small number of larger scale community events, are not 
captured in the project contact or survey-based estimates of 
participation. 

Data analysis 

Prevalence of self-reported participation in Well London across 
all intervention neighbourhoods was calculated overall and for 
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Table 2 Prevalence of participation in any Well London activities reported in the postintervention adult household survey in intervention 
neighbourhoods 

Men (n=802) Women (n=1 084) Total (n=1 886) 

Total sample size (95% CI) (95% CI) (95% CI) 



Total 


1886 


2 4 (1 2 to 3 6} 


3 7 (1 8 to 5 6) 

J . / \ 1 . W LW -J . W j 


3 1 (1 6 to 4 6) 

J.I \ 1 .W LW t T.W/ 


Anp nrnnn f\/p;irO 










16-24 


458 


2.0 (0.2 to 3.7) 


2.3 (0.5 to 4.2) 


2.2 (0.7 to 3.7) 


25-34 


482 


2 0 (0 0 to 3 9) 


2 1 10 0 to 4 4) 

£- - 1 \W . W LW '-r.'-r/ 


2 1 (0 3 to 3 9) 


35-44 


41 1 


1 8 10 0 to 3 8} 


4 S O 0 to 7 0) 

H.J IZ..U LU / .U/ 




45-54 


271 


0 8 (0 0 to 2 4) 


4 7 (1 1 to 8 3) 

i ■ / \ 1 ■ 1 L W W . J / 


3 0 (0 7 to 5 2) 

■J.W \W./ LW .J.Z./ 


55-64 


126 


9.8 (3.0 to 16.6) 


8.0 (0.0 to 18.8) 


8.7 (2.5 to 15.0) 


65+ 


138 


3.4 (0.0 to 8.5) 


5.1 (0.0 to 11.0) 


4.3 (0.4 to 8.3) 


Fthniritv 

LLI II IILI Ly 










White British 


484 


3.4 (0.7 to 6.2) 


3.6 (1.3 to 5.9) 


3.5 (1.4 to 5.6) 


Whitp nthpr 

V V 1 II LC ULI ICI 


330 


1 4 10 S to 3 7) 


Z.. 1 \U.U LU H.U/ 


1 8 (0 0 to 3 7) 

i . o yj . u lu j.i) 


Black Caribbean 


196 


4 2 (0 0 to 8 9) 


8.0 (2.0 to 14.0) 


6.6 (2.0 to 11.3) 


Black African 


399 


0.6 (0.0 to 1 .9) 


2.9 (0.0 to 6.0) 


2.0 (0.0 to 4.2) 


lnHian/Pakktani/Rannlarlp<;hi 

1 1 iuicii 1/ r ui\i jia 1 11/ uai iuigucji 1 1 


221 


0 8 10 0 to 2 4) 

w.w iw t.- fc t/ 


5 9 10 0 to 1 2 6) 

J.-/ \W . W LW IZ..W/ 


3 2 (0 0 to 6 5) 

J . £- \\J . W L W W . J } 


Other Asian 


104 


5.9 (0.0 to 12.8) 


5.7 (0.0 to 1 1 .8) 


5.8 (1.3 to 10.3) 


Mixed 


69 


4.8 (0.0 to 13.4) 


0.0 


1 .4 (0.0 to 4.0) 


Other 


83 


2.6 (0.0 to 6.7) 


0.0 


1 .2 (0.0 to 3.3) 


Fnnli<ih ^ f i ret l^nnn^np 

L.IIUII.MI uj llloL IdllUUuUC 


1013 


2 9 (0 9 to 4 89) 


4 4 (1 8 to 7 0) 

t t. I -T \^ 1 .W LW / .W/ 


3 8 (1 6 to 5 9) 


Encjlish as second IsnguscjG 


873 


1.8 (0.5 to 3.2) 


2.9 (1.4 to 4.4) 


2.4 (1.2 to 3.6) 


Level of educational attainment 










Mn formal mialifiratinrK 

IMU lUlllldl LjUCll 1 1 ILu LIUI 1 J 


196 


0.0 


0 8 (0 0 to ? 4) 

u.o \u.u LU £..Ty 


0 S (0 0 to 1 fi) 

U.J \U.U LU 1 .U/ 


GCSE or equivalent 


643 


2.2 (0.2 to 4.2) 


3.2 (1.3 to 5.2) 


2.8 (1.2 to 4.4) 


A-level or equivalent 


417 


3.5 (1.0 to 6.0) 


4.5 (1.6 to 7.5) 


4.1 (2.3 to 5.9) 


University degree 


591 


2.6 (0.5 to 4.7) 


4.4 (0.1 to 7.8) 


3.6 (0.1 to 6.1) 


Other 


39 


0.0 


10.0 (0.0 to 22.0) 


5.1 (0.0 to 11.0) 


Employment status 










In paid employment 


797 


0.98 (0.0 to 1.9) 


4.7 (1.0 to 8,3) 


2.8 (1.0 to 4.5) 


ILO unemployed (seeking work) 


225 


3.7 (0.0 to 8.0) 


0.9 (0.0 to 2.6) 


2.2 (0.0 to 4.8) 


Full time education 


309 


2.2 (0.0 to 4.4) 


2.3 (0.2 to 4.4) 


2.3 (0.4 to 4.1) 


Unable to work (disability/illness) 


115 


7.0 (0.0 to 17) 


3.5 (1.6 to 8.5) 


5.2 (0.1 to 10.3) 


Not employed not seeking/retired/ 


440 


4.4 (0.2 to 8.4) 


4.3 (2.0 to 67) 


4.3 (2.1 to 6.5) 


Carer/other 










Mean number of projects attended (participants) 


59 


1.4 (0.9 to 1.9) 


1.4 (1.1 to 1.6) 


1.4 (1.1 to 1.6) 


Mean number of sessions attended across all projects (participants) 


59 


4.9 (2.1 to 7.7) 


9.3 (3.3 to 15.3) 


7.8 (3.5 to 12.2) 


GCSE, General certificate of school education; ILO, International Labour organisation. 



different sociodemographic subgroups. Regression models were 
fitted to each of the individual-level trial outcomes, separately 
examining their association with the individual-level self- 
reported participation and each of the neighbourhood-level mea- 
sures of exposure. All hypothesis tests and CIs were based on 
robust SEs to account for clustering. All analyses were conducted 
using complete cases, defined as those survey respondents with 
data for all sociodemographic variables used for adjustment and 
for the outcome of interest. Hypothesis tests were considered sig- 
nificant at p < 0.01 to account for multiple tests. 

RESULTS 

Survey response rate 

The response rate for the adult household survey calculated at 
the household level was 26% and the household refusal rate was 
510/0. 11 

Exposure to the Well London intervention 

The prevalence of participation (in any Well London activity) 
reported by household survey respondents was 3.1% (SE 0.7%) 



and was higher among women than men (table 2). The mean 
number of sessions attended across all projects was also higher 
among women. Self-reported participation increased with age 
and was highest among men and women aged 55-64 years. The 
greatest gender differential in participation was at age 35- 
54 years, with men participating substantially less than women. 
'Other Asians' were the highest participating male group, while 
Black Caribbean women participated most often. Those with 
higher levels of educational qualifications were more likely to 
report participation, although the prevalence of participation 
was substantially higher among women with university degrees 
than men with the same qualifications. Self-reported participa- 
tion was also higher among those who were unable to work/not 
seeking employment compared with those who were working or 
seeking work, and was higher among individuals with English as 
their first language. Employed women were much more likely 
than employed men to participate, but the pattern was reversed 
for men and women who were unemployed and seeking work. 

There was variation between intervention neighbourhoods in 
project contact events per 1000 residents (data not shown), 



600 



Phillips G, et al. J Epidemiol Community Health 2014;68:597-605. doi:1 0.1 136/jech-201 3-202507 



Population health intervention 



which ranged from 143 to 1204 per 1000 (mean 436, SE 58) 
and in the number of project quarters of delivery, ranging from 
21 to 47 (mean 32, maximum possible 182). Spearman's rank 
correlation showed that project contact events and project quar- 
ters of delivery were correlated (p = 0.5, p = 0.03), but that 
neither was correlated with the survey participation rate (data 
not shown). 

Associations between measures of exposure and trial 
outcomes 

A matrix of associations of individual and neighbourhood-level 
measures of exposure with trial health and well-being outcomes 
is shown in table 3 and with trial social outcomes in table 4. 
Full results are provided in the online supplementary file 7. 

Individual-level measures of exposure 

After adjustment for sociodemographic characteristics and base- 
line measures, there were no associations between individual- 
level participation and the primary trial health outcomes (table 3, 
column 1), but self-reported Well London participants were more 
likely to report volunteering and taking action to improve their 
local neighbourhood in the last 12 months than non-participants 
(table 4, column 1). 

Neighbourhood-level measures of exposure 

After adjustment for sociodemographic characteristics and baseline 
measures, there were significant (at p <0.01) associations between 
exposure measures and some outcomes, although these were not 
consistent across the different exposure measures. Survey respon- 
dents living in areas where there was a higher prevalence of self- 
report participation from the survey (table 3, column 2) reported 
eating more portions of fruit and vegetables and were more likely to 
report meeting government guidelines on physical activity for 
obesity prevention (at least seven sessions of 60 min of moderate 
intensity physical activity per week or equivalent). They also 
reported (table 4, column 2) higher levels of social support and were 
more likely to report that they had taken action to solve a problem 
in their area in the past 12 months. After the same adjustments, 
survey respondents in areas with higher project headcounts reported 
(table 3, column 3) higher levels of positive mental well-being 
(Warwick Edinburgh scale). They reported (table 4, column 3) 
greater social connectedness (social network score) and were also 
more likely to report that people in their neighbourhood 'pull 
together to improve it', that individuals in their neighbourhoods 'do 
things to help each other' and that residents from different back- 
grounds in their neighbourhood 'get on'. Finally, after adjustment, 
survey respondents living in areas with more project quarters of 
intervention delivery were more likely to report (table 4, column 4) 
that racial harassment was a problem in their area and to report 
higher levels of incivilities and social disorder. 

DISCUSSION 

In this paper, we have described one individual-level measure 
of 'exposure' to the Well London programme: self-report par- 
ticipation at the time of trial outcome assessment survey; and 
three neighbourhood-level measures of exposure: neighbour- 
hood prevalence of self-report participation (from survey); and 
project-contact event rate and the amount of project time deliv- 
ered during the 3. 5 -year programme, calculated from pro- 
gramme monitoring data. The results from the adult household 
survey conducted at follow-up show a modest level of self- 
reported exposure and that individuals with lower levels of 
education, men who were in work or aged 35-54 years and 
women who were unemployed and seeking work, were less 



likely to report having taken part in the Well London pro- 
gramme. This indicates potential inequity of access for those 
who might benefit most from the intervention. At the neigh- 
bourhood level, there was correlation between the two pro- 
gramme monitoring-derived measures, but neither was 
correlated with the survey-derived neighbourhood prevalence 
of self-report participation. 

While it is commonly reported that individuals in lower socio- 
economic groups are less likely to engage with and/or benefit 
from health improvement interventions, 17-20 it is not possible to 
distinguish between likelihood of participation and likelihood of 
reporting participation. Problems with recall may also mean that 
the self-report prevalence of participation from the survey under- 
represents the levels of participation in the programme. There 
were 14 different projects in which residents could participate, 
which were run at different times during the 3. 5 -year programme 
(see online supplementary file 2); at the time of interview it may 
have been several years since a survey respondent took part in a 
Well London healthy cooking class or went to a community festi- 
val or football tournament. Brand recognition may also have 
been poor in some areas, despite efforts in the survey question- 
naire to provide examples of Well London activities and brand- 
ing, so that respondents may have taken part in an activity but 
not associated it with the Well London programme. 

Turning to the association between exposure measures and 
outcomes, at the individual level, self-report participation 
was only associated with volunteering and taking local 
action, both of which could be subject to reverse causality, 
because individuals who already do these things might be 
more likely to participate in the intervention and/or to recall 
doing so. While there were significant and strong associa- 
tions between the neighbourhood-level/exposure measures 
and some secondary health and social outcomes, there was 
no consistent trend of association across the three participa- 
tion measures or across related outcomes. Although the 
finding of such associations is consistent with the findings of 
the qualitative study 12 that active participation in the pro- 
gramme was key to improvements in well-being, these results 
should be viewed with caution as they could clearly result 
from ecological bias, reverse causality or both, especially 
given that there were no effects on any of these outcomes in 
the main trial analysis. 

There are significant limitations to all of the exposure mea- 
sures that we have presented here. These mirror the challenges 
experienced in previous efforts to monitor and evaluate commu- 
nity health initiatives that used a similar philosophy and 
approach to Well London. 6 ' 8 When working to engage citizens 
in such deprived and disenfranchised communities, it might be 
counterproductive to ask participants repeatedly to complete 
forms and provide personal information to uniquely identify 
them. However, this information is needed to track their 
contact with the programme and their pathway through it to 
estimate prevalence of participation. Residents in these commu- 
nities are often unwilling to give this information because of 
poor relationships with state or authoritative institutions, and to 
ask for it would risk their disengagement from the programme 
where the major aim is to reduce such alienation. In relation to 
the results presented here, we are also not able to say how com- 
prehensively and consistently the anonymous programme moni- 
toring questionnaires were administered by the project delivery 
staff, across different projects and across different intervention 
sites. It is therefore possible that the large variability in project 
time delivered and process evaluation participation prevalence 
could be due to variability in data collection, not the underlying 
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Table 3 Associations between individual and neighbourhood-level measures of exposure and trial health and well-being outcomes 




Individual-level self-report 
participation 




Neighbourhood prevalence of self-report 
participation (per 10% percentage pt 
increase) 


Project contact events per 1000 
population (per 10% percentage pt 
increase) 


Project quarters delivered 




Adjusted OR or mean 
difference* (95% CI) 


p Value 


Adjusted OR or mean 
difference* (95% CI) 


p Value 


Adjusted OR or mean 
difference* (95% CI) 


p Value 


Adjusted OR or mean 
difference* (95% CI) 


p Value 


Primary health outcomes 




















Healthy eating — meeting five-a-day (fruit 


0.8 (0.5 to 1.4) 


0.5 


1.2 (0.7 


to 1.8) 


0.5 


1.0 (1.0 to 1.1) 


0.067 


0.99 (0.97 to 1.01) 


0.2 


and vegetable portions) % 




















Physical activity — meeting 5x30 min 


1.1 (0.6 to 2.0) 


0.7 


1.3 (0.9 


to 2.1) 


0.2 


1.0 (1.0 to 1.1) 


0.3 


0.99 (0.96 to 1.01) 


0.3 


moderate intensity activity per week % 




















Abnormal/borderline 


1.4 (0.5 to 3.7) 


0.5 


1.3 (0.8 


to 2.3) 


0.3 


1.0 (0.9 to 1.1) 


1.0 


1.02 (0.99 to 1.05) 


0.2 


GHQ12 score % 




















Warwick Edinburgh Mental Well-being 


-1.5 (-3.7 to 0.8) 


0.2 


-4.7 (-8 


8 to -0.5) 


0.03 


0.7 (0.3 to 1.1) 


0.002 


0.07 (-0.19 to 0.34) 


0.6 


Scale mean scoret 




















Secondary health outcomes 




















Unhealthy eating- mean scoret 


0.1 (-0.1 to 0.3) 


0.4 


0.1 (-0 


1 to 0.3) 


0.4 


0.0 (0.0 to 0.0) 


0.6 


0.00 (-0.01 to 0.01) 


0.5 


Healthy eating — number of portions of 


0.2 (-0.6 to 1.0) 


0.7 


1.0 (0.3 


to 1.7) 


0.009 


0.0 (-0.1 to 0.1) 


0.6 


-0.02 (-0.05 to 0.01) 


0.1 


fruit and vegetables per day — mean 




















Meeting 7x60 min moderate intensity 


1.2 (0.6 to 2.4) 


0.6 


2.8 (1.6 


to 5.1) 


<0.001 


10. (0.9 to 1.1) 


0.8 


0.98 (0.96 to 1.01) 


0.2 


activity per week % 




















Doing 1 50 min of moderate intensity 


1.2 (0.7 to 1.2) 


0.5 


1.1 (0.7 


to 1.7) 


0.8 


1.1 (1 to 1.1) 


0.096 


0.98 (0.96 to 1.01) 


0.3 


activity per week % 




















Mean MET minutes per week — mean 


654 (-85 to 139) 


0.08 


1615.3 (413 


.2 to 2817.4) 


0.011 


-46.7 (-204.6 to 111.2) 


0.5 


-22.1 (-61.1 to 16.9) 


0.3 


Mental Health-GHQ 12— mean score§ 


0.1 (-0.4 to 0.45) 


0.8 


0.1 (-0 


2 to 0.5) 


0.3 


0.0 (0.0 to 0.0) 


0.7 


0.01 (-0.01 to 0.02) 


0.3 


All analyses adjusted for clustering at LSOA level. 

*ORs (binary outcomes) and mean differences (continuous outcomes) adjusted for sociodemographic characteristics: age, gender, ethnicity, employment status, educational attainment and area summary health outcome measures (collected 

cross-sectionally at baseline.). 

tHigher score indicates better mental health. 

^Higher score indicates more unhealthy food consumption. 

§Higher score indicates poorer mental health. 

GHQ, general health questionnaire; MET, metabolic equivalent. 



Table 4 Individual and neighbourhood-level measures of exposure and trial social outcomes 








Neighbourhood prevalence of 




Project contact events per 1000 








Individual-level self-report 




self-report participation (per 10% 


population (per 10% percentage pt 








participation 




percentage pt increase) 




increase) 




Project quarters delivered 






Adjusted OR or mean 




Adjusted OR or mean 




Adjusted OR or mean 




Adjusted OR or mean 






difference* 




difference* 




difference* 




difference* 






(95% CI) 


p Value 


(95% CI) 


p Value 


(95% CI) 


p Value 


(95% CI) 


p Value 


Social networks score* 


-0.1 (-7.25 to 7.0) 


1.0 


-26.7 (-50.2 to -3.2) 


0.028 


3.2 (1 .8 to 4.6) 


<0.001 


0.41 (-0.47 to 1 .29) 


0.3 


Social support score§ 


1.1 (-0.1 to 2.4) 


0.07 


3.5 (1.7 to 5.2) 


0.001 


-0.2 (-0.4 to 0) 


0.03 


-0.03 (-0.10 to 0.04) 


0.4 


Social integration 


















Some/most people in neighbourhood can be trusted 


0.8 (0.4 to 1 .7) 


0.5 


1 1 tn 1 0) 
1 . 1 \\J .0 LU L.\J) 


n q 

U.J 


11 fl tn 1 91 

I.I \\ LU 1 .L) 


0 037 


1 .01 (0.96 to 1 .06) 


0.8 


People from different backgrounds in the 


0.6 (0.2 to 1 .9) 


0.4 


1 3 IC\ A +/-. A n\ 

1 .3 to 4.U) 


0.7 


11 M tn 1 l\ 
I.I (I to I .1) 


0.003 


1 .01 (0.97 to 1 .05) 


0.7 


neighbourhood get on 


















Racial harassment is a problem 


1.3 (0.5 to 3.2) 


0.6 


0.9 (0.2 to 4.5) 


0.9 


1.0 (0.8 to 1.1) 


0.6 


1.10 (1.04 to 1.18) 


0.002 


Collective efficacy 


















People in the neighbourhood pull together to 


0.6 (0.3 to 1.3) 


0.2 


0.3 (0.1 to 0.9) 


0.038 


1.3 (1.1 to 1.4) 


<0.001 


1.04 (0.98 to 1.10) 


0.2 


improve it 


















People in the neighbourhood help each other and 


1.8 (0.8 to 4.2) 


0.2 


0.9 (0.4 to 2.4) 


0.9 


1.1 (1 to 1.2) 


0.005 


1.02 (0.99 to 1.06) 


0.3 


do things together 


















Taken any action to solve problems in the local area 


3.6 (2.0 to 6.5) 


<0.001 


4.1 (1.5 to 11.3) 


0.007 


1.0 (0.9 to 1.1) 


0.5 


1.01 (0.97 to 1.06) 


0.6 


in past 12 months 


















Volunteering — any activity in last 12 months 


3.9 (2.0 to 7.7) 


<0.001 


2.1 (0.7 to 5.9) 


0.2 


0.9 (0.8 to 1) 


0.061 


1.01 (0.97 to 1.04) 


0.8 


Antisocial behaviour — resident perceptions score§ 


0.2 (-0.2 to 0.7) 


0.3 


-0.3 (-1.2 to 0.6) 


0.5 


0.1 (-0.1 to 0.2) 


0.2 


0.06 (0.03 to 0.10) 


<0.001 


Fear of crime 


















Feel safe in the neighbourhood (day) 


0.4 (0.1 to 0.9) 


0.03 


0.6 (0.3 to 1.3) 


0.2 


1.0 (0.9 to 1.1) 


0.9 


0.96 (0.93 to 1.00) 


0.05 


Feel safe in the neighbourhood (night) 


1.5 (0.9 to 2.6) 


0.1 


0.9 (0.6 to 1.5) 


0.8 


1.0 (0.9 to 1.0) 


0.4 


0.97 (0.94 to 1.01) 


0.1 


All analyses adjusted for clustering at lower super output area level. 
















*ORs (binary outcomes) and mean differences (continuous outcomes) adjusted for sociodemographic characteristics: age, gender, ethnicity, employment status, educational attainment. 








^Higher score indicates greater social connectedness. 


















§Higher score indicates greater social support. 


















HHigher score indicates higher levels of perceived incivilities (survey respondents). 

















Population health intervention 



phenomena of delivery and engagement we assume these data 
represent. 

In multilevel interventions that combine components concep- 
tualised as traditional behaviour change activities (where 'expos- 
ure' is clearly observable and quantifiable) with activities that 
attempt to address the more indirect but perhaps more funda- 
mentally important influences on health and well-being such as 
social norms, social support and the health architecture of the 
local environment (food options, urban layout), there is a bias 
towards measuring exposure to the individual-level activities. 
Even where previous studies have attempted to weigh the rela- 
tive impact of intervention components acting at these different 
levels to provide a universal measure of programme exposure, 6 
these weights are somewhat arbitrary and may not be grounded 
in any substantial health-related theory. Other studies have used 
more qualitative measures to represent the degree of 'commu- 
nity activation', but these do not lend themselves to the types of 
exposure analyses we have attempted here. 7 

The qualitative study embedded in this CRT 12 has shown that 
interviewees were sometimes unsure whether they had taken 
part in Well London, identifying themselves initially as partici- 
pants or non-participants but then revealing information during 
in-depth interviews that suggested the opposite. This suggests 
that 'participation' in a multicomponent, community-based 
intervention is exceptionally difficult to define, and therefore to 
measure, because it is differently interpreted by the research 
team, the intervention delivery staff and members of the 
community. 

Some might suggest that attempting to measure the 'dose' of 
community engagement that individuals or communities 
receive completely misses the point of this approach, 21 or at 
least that the way that individuals engage with such pro- 
grammes is far less mechanistic than the way we have concep- 
tualised participation in the measures presented here. Simple 
volume of contact, even when weighed for different levels of 
educational intensity, 6 does not capture the complex and multi- 
faceted processes by which the behaviour and self-concept of 
individuals may be affected and changed by such socially 
oriented health interventions. 

Despite these criticisms, it is important to investigate levels 
of participation in some way, to highlight inequities of access, 
and whether the data from the self-report survey are taken at 
face value, they certainly warn us not to see deprived commu- 
nities as homogeneous and point to the need to be vigilant so 
that the most disadvantaged and socially excluded individuals 
within them are not overlooked. In future studies it may be 
beneficial to explore the pathways that people take through 
complex multicomponent interventions such as Well London to 
help examine the 'active ingredients' of the programme for dif- 
ferent individuals and different outcomes, rather than trying to 
capture all contact events. While there will still be limitations 
to these approaches (eg, Hawthorne effect, recruitment bias), 
recruiting a cohort of residents in intervention areas to be fol- 
lowed through the intervention, whether they participate or 
not, and/or recruiting a cohort of engaged participants after 
programme initiation are two possibilities. There is a need to 
experiment with using new mixed methods and participatory 
approaches to understand in more detail the ways in which 
individuals engage with community programmes and the way 
that this engagement may, or may not, impact on health and 
social outcomes that are the focus of public health and public 
policy. However, funders of interventions and evaluations of 
these must become more realistic about the resources that will 
be needed to achieve this. 



What is already known on this subject 



It has been suggested that process measures, including 
measures of exposure, should be considered as essential 
components of trials of complex public health interventions. 
This is because they can help to monitor dose and reach of the 
intervention, investigate contextual factors that influence effect, 
explore the relationship between trial outcomes and variation in 
the extent and quality of the implementation of the intervention 
and identify processes that might mediate the relationship 
between intervention and outcomes. A substantial body of work 
exists on measuring exposure to social marketing and other 
blanket media health promotion campaigns, which focus on 
survey recall. Less attention has been paid to measuring 
'exposure' to complex public health interventions delivered 
through community engagement approaches. Previous studies of 
community interventions have looked at the level of provision 
and actual contact with the programme using management 
systems during delivery. However, these interventions have 
focused on educational and screening activities in community 
healthcare settings. 



What this study adds 



This study describes survey and programme management 
data-based approaches to measuring exposure to the Well 
London health improvement programme. We found 
sociodemographic variation in survey-based exposure measures. 
We found correlation between our two management 
data-derived neighbourhood-level measures of exposure but no 
correlation between these and survey-derived measures. We 
found some significant associations between the 
neighbourhood-level exposure measures and some outcomes 
that might suggest intervention effects not detected in the main 
trial but were not consistent across measures or related 
outcomes that might suggest reverse-causation or ecological 
bias . We discuss some of the implications of these findings for 
collecting, using and interpreting both types of data, with 
particular reference to community engagement in deprived 
urban areas. 
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